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METHOD AND APPARATUS FOR MANAGING IMAGES, AND RECORDING MEDIUM 
HAVING AN IMAGE MANAGING PROGRAM RECORDED THEREIN 
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[0020] 

Figure 2 illustrates an example of text data attachment 
by the apparatus illustrated in Figure 1. The text data 
attaching section 4 that attaches text by referring to schedules 

10 uses a schedule file 41, which is an external related data file, 
regarding each of the image data files 11 illustrated in Figure 
2 and attaches text data thereto, such as locations. In 
addition, the text data attaching section 5 that attaches text 
according to the similarities among images matches the features 

15 of images against those of sample images, which are prepared 
as matching image feature data 51, and attaches text data 
thereto, such as categories of subjects, which are attached to 
similar images in advance. 
[0021] 

20 For example, image #3 from among the image data files 11 

is an image which was photographed at 9 o'clock. Therefore, 
the schedule file 41 is referred to, the location "C" is added 
to the image data file 11, and the image data file is displayed 
as image data 6, to which text data has been added. In addition, 

25 the text data attaching section 5 that attaches text according 
to the similarities among images attaches text data indicating 
"balloon". The details of these processes will be described 
later. 
[0022] 

30 Note that an embodiment of the present invention is 

possible, wherein only one of the text data attaching section 

4 that refers to the schedule and the text data attaching section 

5 that attaches text data according to the similarities among 
images attaching text data. 

35 [0023] 



Figure 3 is a flow chart that illustrates the steps of 
the overall process. Image data within an image data file 11 
is input to the image managing section 2 by the image input 
section 1, at step SI. An image feature extracting section 21 
5 of the image managing section 2 extracts features from the input 
image, at step S2. 
[0024] 

Figure 4 illustrates examples of extracted image features. 
Figure 4 illustrates an example, in which features are extracted 

10 from image data having image ID #3 according to predetermined 
feature extraction rules 210. The extracted features are 
numerical values that represent statistical data regarding the 
colors included in the image data, and numerical values that 
represent the characteristics of shapes. The extraction 

15 results are stored in a feature file 211 . The processing method 
according to the feature extraction rules 210 are similar to 
formulas which are used to extract features. The technique 
described in detail in "Image Content Search Techniques Based 
On Surface Features Such As Colors and Shapes" of aforementioned 

2 0 Reference Document 1 may be employed as the feature extraction 
process. There are well known techniques for feature 
extraction from images, and therefore, further detailed 
descriptions thereof will be omitted here. 
[0025] 

25 Next, the text data attaching section 4 that refers to 

schedules employs the schedule file 41 to attach text data, such 
as location, at step S3. The text data attaching section 5 that 
attaches text data according to similarities among images 
compares the features of the image against those of sample 

30 images, and attaches text data of the similar images, at step 
S4. 

[0026] 

At step S5, feature managing section 22 correlates the 
input image, the features obtained in step S2, and the text data 
35 attached in steps S3 and S4. The image output section 3 outputs 



the image and the text data attached thereto as necessary, at 

step S6. 

[0027] 

The process performed by the text data attaching section 
5 4 that refers to schedules will be described in further detail 
with reference to Figure 5 and Figure 6. Figure 5 is a flow 
chart that illustrates the steps of the process performed by 
the text data attaching section 4 that refers to schedules. 
[0028] 

10 First, time data of the image data which is the target 

of the process is obtained, at step S10. The time data is that 
which is attached to photographs obtained by a digital camera 
having a time stamp function, for example. In the case that 
time data is attached to the image data itself as attached data, 

15 the time data may be used. In the case that the time data is 
photographed in the image as subtitles, simple text recognition 
techniques may be employed to extract the time. 
[0029] 

Next, time, location, and other schedule data are read 
20 out from the schedule file 41, at step Sll. 
[0030] 

At step S12, the schedule data is analyzed according to 
predetermined schedule rules 40, and the location and the like 
at the time that the image data was obtained is specified. The 

25 schedule rules 40 are conversion rules as illustrated in Figure 
6, for example. In the example of Figure 6, the time data of 
the image data is designated as T, and the schedule rules 4 0 
dictate that if T is between "time m" and "time n", that the 
location of photography is "location P" . Regarding the image 

30 having image ID #3, T is "9:00", time m is "8:30", and time n 
is "10:30". Accordingly, "C" is selected as the location P. 
[0031] 

At step S13, text data related to the location is attached 
to the image data. As a result, "image ID = #3"; "time = 9:00"; 
35 and "location = C" are stored as text data, in a text data result 



file 42. 
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PROBLEM TO BE SOLVED: To reduce the 
manual work when managing an Image while 
applying bibliographical information to the 
image for facilitating the utilization or 
management of the image. SOLUTION: A 
bibliographical information applying part 4 
based on schedule reference compares the 
time information of image data inputted from 
an image data file 1 1 with the time information 
of schedule information, which is external 
related information, inputted from a schedule 
file 41 and applies the contents of relevant 
schedule information as bibliographical 
information. Besides, a bibliographical 
information applying part 5 based on similar 
images collates a feature quantity extracted 
from the input image data with the feature 
quantity of a large quantity of sample images 
previously stored as image feature data 51 for 
collation, selects any similar image and applies 
bibliographical information applied to that 
similar image as bibliographical information of 
the input image data. 
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